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EFFICIENT RATE CONTROL FOR MULXI- quantized coefficients may be zig-zag scanned and run- 

RESOLUTION VIDEO ENCODING amplitude coded before being applied to a variable-length 

coder (VLC) 26. The output of the VLC 26 is an encoded 

FIELD OF THE INVENTION bitstream. Rate control is provided by a rate control proces- 

^, . . , « i L . L 5 sor 28. The DCT, quantization and variable-length coding 

T*e invention relates generally to video encoding which operalions of Fia 2 are designed to remove spatial redun- 

utilizes motion-compensated video compression techniques, dancy wilhin a given video ^ lhe ^e^. 

and more particularly to rate control in multi-resolution Temporal or inter-frame redundancy is removed in the 

video encoding applications. encoder of FIG. 2 through a process of inter-frame motion 

BACKGROUND OF THE INVENTION io e *™ n and P r £ ict * e ing -J°[ ^ PEG , 2 

video frames may be either intra -coded (I) frames, forward- 
Motion video sequences typically contain a significant only predictive (P) frames or bidirectionally-predictive (B) 
amount of intra-frame or "spatial" redundancy as well as frames. An I frame is encoded using only the spatial com- 
inter-frame or "temporal" redundancy. Video compression pression techniques noted above, while a P frame is encoded 
techniques take advantage of this spatial and temporal using "predictive" macroblocks selected from a single ref- 
redundancy to significantly reduce the amount of informa- erence frame. A given B frame is encoded using 
tion bandwidth required to transmit, store and process video "bidirectionally-predictive" macroblocks generated by inter- 
sequences. Existing standards for digital video compression P olatin g to*™** * of predictive macroblocks selected 
include, for example, H.261, H.263, Motion-JPEG, %om two reference frames, one precedmg and the other 
MPEG-1 and MPEG-2. Transmission of compressed digital on fo » owin S the B i r ? me * encoder of FIG. 2, the output 
. , . , „ 5 20 of the quantizer 24 is applied to an inverse quantizer 30 and 
video can take place over many types or transmission . T\r~r ♦ n , 4 f 
..... , . , m li l j -j l then to an inverse DCT generator 32. The output of the 
facilities, and with many available bandwidths. For DCT ator 32 ig ^ over one or more 

example, in a multipoint transmission application, two or frames b a motion cornp ensator 34 and motion estimator 

more receivers of a compressed video bitstream may each 36 The molioQ competitor 34 generates motion vectors 

have different available bandwidths with which to receive ^ which are combined with a subsequent frame in signal 

the video data. It is generally desirable in such an application combiner 20 so as to reduce inter-frame redundancy and 

to allow a receiver with a high bandwidth to receive higher facilitate encoding. 

resolution video than a receiver with a low bandwidth, rather A conventional video encoder such as that shown in FIG. 

than limiting all of the receivers to the low bandwidth. In 2 generally attempts to match the bitrate of the compressed 

these and other similar applications, a given video sequence 3Q strea m to a desired transmission bandwidth. The 

is encoded at multiple resolutions. quantization parameter (QP) used in the quantizer 24 gen- 

The MPEG-2 standard implements multi-resolution video erally has a substantial effect on the resultant bitrate: a large 

encoding through a process known as spatial scalability. QP performs coarse quantization, reducing the bitrate and 

This involves encoding a base layer of the video at a lower the resulting video quality, while a small QP performs finer 

resolution and one or more enhancement layers at higher 35 quantization, which leads to a higher bitrate and higher 

resolutions. The base layer is then transmitted to all receiv- resulting image quality. The rate control processor 28 thus 

ers in a multipoint transmission application, and the attempts to find a QP that is high enough to restrain the 

enhancement layer or layers are transmitted only to the bitrate, but with the best possible resulting image quality. In 

higher bandwidth receivers. However, MPEG-2 spatial seal- general, it is desirable to maintain consistent image quality 

ability requires the higher bandwidth receiver to decode two 40 throughout a video sequence, rather than having the image 

or more layers, which increases the computational complex- quality vary widely from frame to frame. Both the MPEG-2 

ity of the decoding process. In addition, the bandwidth simulation model and the H.263 test model suggest rate 

required for transmitting two or more layers is generally control techniques for selecting the QP. 

higher than that required for transmitting a single bitstream Approaches for implementing this type of rate control are 

encoded at the higher resolution. Additional detail regarding 45 described in greater detail in, for example, A. Puri and R. 

these and other aspects of the MPEG-2 standard are Aravind, "Motion-Compensated Video Coding with Adap- 

described in greater detail in "Information Technology t ive Perceptual Quantization," IEEE Transactions on Cir- 

Generic Coding of Moving Pictures and Associated Audio an d Systems for Video Technology, Vol. 1, No. 4, pp. 

Information: Video," ISO/IEC DIS 13818-2, which is incor- 351-361, December 1991, and W. Ding and B. Liu, "Rate 

porated herein by reference. 50 Control of MPEG Video Coding and Recording by Rate- 

FIG. 1 shows a conventional multi-resolution encoding Quantization Modeling," IEEE Transactions on Circuits and 

system 10. A video sequence in Common Intermediate Systems for Video Technology, Vol. 6, No. 1, pp. 12-20, 

Format (OF) is supplied directly to a first standard video February 1996, both of which are incorporated by reference 

encoder 12 and also to a downsampler 14. The first standard herein. These approaches generally first select a target 

video encoder 12 encodes the CIF video sequence to gen- 55 bitrate for each frame type (i.e., I frames, P frames and B 

erate a CIF bitstream. The downsampler 14 converts the CIF frames), and the encoder attempts to assign the same number 

video sequence to a Quarter-CIF (QCIF) video sequence. A of bits to each frame of the same type. A frame-wide QP is 

second standard video encoder 16 encodes the QCIF video then determined for each frame in an attempt to match the 

sequence to generate a QCIF bitstream. The two encoders target bitrate for that frame. The approach described in the 

12, 16 operate substantially independently, and generally do 50 Puri and Aravind reference determines the frame- wide QP 

not share rate control information. by using an activity measure, the frame variance. The 

FIG. 2 shows one of the standard video encoders 12, 16 approach described in the Ding and Liu reference generates 

of FIG. 1 in greater detail. The CIF or QCIF video sequence a rate-quantization model. In either approach, the encoder 

is applied via a signal combiner 20 to a discrete cosine may also vary the QP for individual macroblocks based on 

transform (DCT) generator 22 which generates DCT coef- 65 local activity measures. 

ficients for macroblocks of frames in the sequence. These A significant problem with these and other conventional 

coefficients are applied to a quantizer 24, and the resulting rate control techniques is that they can be computation 



05/06/2004, EAST Version: 1.4.1 



US 6,343,098 Bl 



I: 



intensive, particularly for high resolution video sequences. 
For example, the approach in the Ding and Liu reference 
performs multi-pass encoding, that is, an entire frame is 
encoded more than one time using different QPs in order to 
find a QP that results in an actual bitrate closer to the target 
bitrate. This type of multi-pass encoding can be very com- 
putation intensive, and substantially reduces the efficiency 
of the encoding process. 

SUMMARY OF THE INVENTION 

The invention provides a multi-resolution video encoding 
system which improves the computational efficiency asso- 
ciated with encoding a video sequence in two or more 
different resolutions. An illustrative embodiment includes a 
first encoder for encoding the sequence at a first resolution, 
and a second encoder for encoding the sequence at a second 
resolution, where the second resolution is higher than the 
first resolution. Information obtained from encoding the 
f 'sequence at the first resolution is used to provide rate control 
1- for the sequence at the second resolution. This information 
t may include, for example, a relationship between a quanti- 
i zation parameter selected for an image at the first resolution 
«nd an actual output bitrate generated by encoding the image 
r jusing the selected quantization parameter. 

| An exemplary rate control process implemented in the 
above-described illustrative embodiment may first deter- 
mine target bitrates for different types of images at each of 
the first and second resolutions. The target bitrates may be 
set independently for each of the first and second 
resolutions, or alternatively maintained in a fixed ratio. The 
process then utilizes a rate-quantization model to select a 
quantization parameter for use with a given one of the 
images of the sequence at the first resolution. The selected 
quantization parameter is the quantization parameter which 
best matches the target bitrate for the first resolution. An 
estimated bitrate is determined for the image at the first 
resolution to be encoded using the selected quantization 
parameter, by dividing the target bit rate for the second 
resolution by a factor. The rate-quantization model is then 
used to determine a quantization parameter for an image at 
the second resolution, by finding the best quantization 
parameter for encoding the image at the first resolution to 
achieve the estimated number of bits for the image. The 
above-noted factor may be updated as the sequence is 
encoded by, for example, recomputing it as a moving 
average of the ratio between: (1) an actual number of bits 
used when encoding the image at the second resolution 
using the determined quantization parameter, and (2) the 
number of bits which the rate -quantization model estimates 
[ ijjvill be required for encoding the image at the second 
I ^resolution. 

| The invention improves the computational efficiency of 
multi-resolution video encoding by using information gen- 
Jerated during the encoding of lower resolution images to 
facilitate the encoding of higher resolution images. Unlike 
the conventional spatial scalability approach described 
previously, the invention can allow each receiver in a 
multipoint transmission application to choose its own 
single-resolution video stream, such that each receiver 
makes the most efficient use of its own available bandwidth. 
The invention can be used with a variety of video encoding 
standards, including H.261, H.263, Motion-JPEG, MPEG-1 
( and MPEG-2. These and other features and advantages of 60 
the present invention will become more apparent from the 



^accompanying drawings and the following detailed descrip- 
tion. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of a conventional multi- 
resolution video encoding system; 



FIG. 2 is a block diagram of one of the standard video 
encoders in the conventional multiresolution video encoding 
system of FIG. 1; 

FIG. 3 is a block diagram of a multi-resolution video 
encoding system in accordance with an exemplary embodi- 
ment of the invention; 

FIG. 4 is a block diagram of a multi-resolution video 
encoder suitable for use in the encoding system of FIG. 3; 
and 

io FIG. 5 is a flow diagram illustrating a rate control process 
which may be implemented in the multi-resolution video 
encoder of FIG. 4. 

DETAILED DESCRIPTION OF THE 
INVENTION 

15 

The following description will illustrate the invention 
using an exemplary two- resolution video encoding system. 
It should be understood, however, that the invention is not 
limited to use with any particular type of video signal 
20 format, video encoding standard or encoding system con- 
figuration. The invention is instead more generally appli- 
cable to any video encoding system in which it is desirable 
to improve the efficiency of an encoding process for gener- 
ating encoded bitstreams in two or more resolutions. The 
25 term "video sequence" should be understood to include any 
frame or field sequence which is in a form suitable for 
encoding in accordance with standards such as, for example, 
H.261, H.263, Motion-JPEG, MPEG-1 and MPEG-2. The 
term "image" as used herein refers to a frame or field of a 
30 video sequence. The term "block" as used herein is intended 
to include not only macroblocks as defined in the above- 
noted compression standards, but more generally any group- 
ing of pixel elements in a video frame or field. 

The invention improves the computational efficiency of 
35 multi-resolution video encoding by using information gen- 
erated during the encoding of lower resolution images to 
facilitate the encoding of higher resolution images. Unlike 
the conventional spatial scalability approach described 
previously, the invention can, for example, allow each 
40 receiver in a multipoint transmission application to choose 
its own single-resolution video stream. This is generally a 
bandwidth-efficient solution in that each receiver makes the 
most efficient use of its own available bandwidth. To imple- 
ment this aspect of the invention, a multi-resolution encod- 
45 ^g«system^ffcotiein 

wjth^differing^lev^lk ofcbitf ate^and' resolution . . Although>the > 
resultingJbitstreams^arTbe decoded independently of one 
another, they are generated-by encddmg-dffierenr resolution^ 
^versidns-of the same video sequence. 
50 FIG. 3 shows a multi-resolution video encoding system 
40 in accordance with an illustrative embodiment of the 
invention. The encoding system 40 in this embodiment 
utilizes the H.263 video encoding standard, and the system 
provides output bitstreams at two different resolutions: CIF 
and QCIF. As previously noted, the techniques to be 
described are applicable to other video encoding standards, 
and to any number of different resolutions greater than or 
equal to two. The system 40 includes an efficient multi- 
resolution video encoder 42 and a downsampler 44. An input 
CIF video frame sequence is applied directly to an input of 
the multi-resolution encoder 42 and also to an input of the 
downsampler 44. The downsampler 44 converts the CIF 
video frame sequence to a QCIF video frame sequence. The 
QCIF video sequence is applied to another input of the 
65 multi-resolution encoder 42. 

The CIF video sequence in system 40 may be any 
sequence of progressive or interlaced frames suitable for 
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encoding in accordance with a video compression technique rate control processor 60 is coupled to an input of the 
such as H.263. A progressive frame sequence generally has quantizer 76. The output of the quantizer 76 is also applied 
a frame rate of 30 frames per second with a single field in to an inverse quantizer 82 and then to an inverse DCT 
each frame, while an interlaced frame sequence generally generator 84. The output of the inverse DCT generator 84 is 
includes two fields in each frame and therefore will include 5 processed over multiple frames by a motion compensator 86 
60 fields per second at a 30 frame per second frame rate. The and mol i on estimator 88. The motion compensator 86 gen- 
two fields in each frame of the interlaced sequence include erates mot j OD vectors which are combined with a subsequent 
an even field corresponding to even scan lines and an odd q C1F frame in sigQal com biner 72 so as to reduce inter- 
field corresponding to odd scan fines. The video sequence redundancy and facilitate encoding of the QCIF frame 
may be supplied from a video source such as a video camera, lfJ sequence. 

a telecine source, a video receiver, a digital video disc ™ . . c t . , , « mr i 

i • • * j t r The operation of the rate control processor 60 of FIG. 4 

(DVD) drive, a video cassette recorder, other - types of ^ ^ f ^ ^ m ^ 

magnetic or optica drives, and the hke. Agiven video frame ahjsXr3tive embodimem efficiently determines a frame-wide 

is divided into a plurality of macroblocks, with each mac- . . . /nkTA f - e „ tU . »*n 

*~ o oli i ri • i j quantization parameter (QP) for a given frame that will 

roblock including four 8x8 blocks of luminance samples and ^ , , , . . . u-. . r .u c 

5 * . 15 approximately match a target bitrate for the given frame 

either two or four 8x8 blocks of chroma samples. r , r - ; , j , c f, c . . , 

v when that frame is encoded. It makes use of the fact that 

The video frame sequence suitable for encoding may be muUi le resollUions of lhe same video sequence are being 

generated from an NTSC or PAL analog video signal. NTSC eocoding simultaneously in the system 40. More 

video signals utilize 525 scan fines per frame and a frame parlicularly> information acquired by performing the QCIF 

rate of 30 frames per second, while PAL video signals utilize 20 erjcodi such as me re i at i 0 nship between the quantization 

625 scan fines per frame and a frame rate of 25 frames per eter and lhe resullant bitratC) ^ used to perform the 

second. The above-noted video source may generate an Qp encoding. There is a strong correlation between the 

analog NTSC or PAL video signal which is converted in a Qumber of ^ fequired tQ encode a OT ^ at a ^ 

well-known manner to a video sequence in the CIF format quantization parameter with the number of bits required to 

In applications in which the video sequence is generated 25 eQCode lhe cmre!?K)Ilding QC IF image at the same quanti- 

from film, the sequence may include telecine material gen- ?ation parameter Experiments have shown that the relation- 

erated using a 3:2 pulldown technique. A 3:2 pulldown ghi ^ approximately lineaj for several different types of 

technique converts film having a frame rate of 24 frames per common videQ nces< The relationship may be 

second into a 60 field per second digital video sequence. expressed as* 

FIG. 4 shows an illustrative embodiment of the multi- 30 

resolution video encoder 42. The CIF video sequence is bits c// , -Brrs oc// , * factor, 
applied via a signal combiner 52 to a discrete cosine 

transform (DCT) generator 54 which generates DCT coef- where bits c/f * the number of bits required to encode a 

ficients for macroblocks in frames of the CIF frame CIF frame at a g iven ^ BITS c?c/^ is the number of bits 

sequence. These coefficients are applied to a quantizer 56, 35 rc q wrcd t0 encode the corresponding QCIF frame at the 

and the resulting quantized coefficients are applied to a S iven Q p > and FACTOR is a number which vanes slightly 

variable-length coder (VLC) 58. In other embodiments, for different types of video sequences, but generaUy does not 

additional processing operations, such as zig-zag scanning var y S rcatl y for different frames of the same sequence, 

and run-amplitude coding, may be performed on the quan- FACTOR tends to be in the range of about 2.5 to 3 for CIF 

tized coefficients prior to variable-length coding. The output 40 and QCIF ima S es encoded 11263 compression, 

of the VLC 58 is an encoded CIF bitstream. Rate control is FIG * 5 is a flow diagram illustrating the rate control 

provided, in a manner to be described in detail below, by a P rocess implemented in the rate control processor 60. In step 

rate control processor 60. The output of rate control proces- 100 > tar S et bltrates ^cif and TB^ are determined for 

sor 60 is coupled to an input of the quantizer 56. The output each tv P e of frame m ^ CIF and Q CIF resolutions, 

of the quantizer 56 is applied to an inverse quantizer 62 and 45 respectively. These target bitrates may be determined, for 

then to an inverse DCT generator 64. A motion compensator example, in the manner described in A. Puri and R. Aravind, 

66 and motion estimator 68 process the output of inverse "Motion-Compensated Video Coding with Adaptive Percep- 

DCT generator 64 over multiple frames. The motion com- tual Quantization," IEEE Transactions on Circuits and Sys- 

pensator 66 generates motion vectors which are combined tems for Vldeo Technology, Vol. 1, No. 4, pp. 351-361, 

with a subsequent CIF frame in signal combiner 52 so as to 50 December 1991 > and W - Dm S and B - Liu > " Rale Control of 

reduce inter-frame redundancy and facilitate encoding of the MPEG Vldeo Codin g and Recording by Rate-Quantization 

CIF frame sequence Modeling," IEEE Transactions on Circuits and Systems for 

The QCIF video sequence from the downsampler 44 is ™eo Technology Vol. 6, No 1, pp. 12-20 February 1996. 

applied via a signal combiner 72 to a DCT generator 74 0lber suA3bU techniques could also be used. In step 102, a 

which generates DCT coefficients for macroblocks in frames 55 rate-quantization model such as that described m the Ding 

of the QCIF frame sequence. These coefficients are applied Liu reference is used to hnd a quantization parameter 

to a quantizer 76, and the resulting quantized coefficients are for v*™* 1 a S| ven ° ne ° f tbe reso ' u,1 °" 

applied to a VLC 78. As in the CIF encoding described QCI ^ frames - ™? parameter QP^ should 

above, alternative embodiments may perform additional ^ihe one which best matches the QCIF target bitrate 

processing operations, such as zig-zag scanning and run- 60 ™<&r- Io jf* an bitrate EB^ is deter- 

amplitude coding of the quantized coefficients, prior to m,ned for the QCIF frame to be encoded usuig QP ec/f , 

variable-length coding. The output of the VLC 78 is an based on the lowing equation: 

encoded QCIF bitstream. Rale control for the QCIF encod- EB 0C/ ^.TB c ,^FACrDR, 
ing is also provided by the rate control processor 60, as will 

be described in greater detail below in conjunction with the 65 where FACTOR is defined in the manner previously 

flow diagram of FIG. 5. An output of VLC 78 is coupled to described. The rate-quantization model is then used in step 

an input of the rate control processor 60, and an output of the 106 to determine QP CIF . This involves finding the best QP 
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for encoding the QCIF frame to achieve EB^^ bits for the wherein target bit rates are determined for each of the first 

frame. The resulting QP C/F is then used to encode the and second resolutions, a first quantization parameter is 

corresponding CIF frame in step 108. The value of FACTOR selected for encoding at the first resolution based on the 

is updated in step 110. This update may involve, for target bit rate for the first resolution, an estimated bit 

example, recomputing FACTOR as a moving average of the 5 rate is determined for encoding at the first resolution 

ratio between: (1) the actual number of bits used when using the first quantization parameter based on the 

encoding the CIF frame using the quantization parameter target bit rate for the second resolution, and a second 

QP C/F in step 108, and (2) the number of bits which the quantization parameter is selected for encoding at the 

rate-quantization model estimates will be required for second resolution based on the estimated bit rate for 

encoding the QCIF frame using the same quantization v^en coding at the first resolution, 

parameter QP cir . /^jffihe method of claim 1 wherein the first resolution is a 

The above -described rate control process provides sub- resolution and the second resolution is a CIF resolu- 

stantially improved computational efficiency in encoding a ^SP^d 

CIF frame, relative to direct application of the rate- ^3j?The method of claim 1 wherein the utilizing step 

quantization model to the CIF frame as in conventional includes utilizing information from the encoding at the first 

techniques. Forming the rate -quantization model generally 15 resolution to provide rate control for the sequence at two or 

requires two passes of quantization and variable length mor^additional resolutions. 

coding for a given frame. It is substantially less computa- /^raThe method of claim 1 wherein the information from 

tionally expensive to perform these two passes only on a tfhe encoding at the first resolution that is utilized to provide 

QCIF frame, as in the illustrative process of FIG. 5, rather rate control for the sequence at a second resolution includes 

than performing two passes on both a QCIF frame and the 20 a relationship between a quantization parameter selected for 

corresponding CIF frame as in conventional techniques. an image at the first resolution and a resultant output bitrate 

This is because the QCIF frame has one-fourth the resolu- generated by encoding the image using the selected quan- 

tion of the corresponding CIF frame, and therefore requires tization parameter. 

only about one-fourth the number of computations. The rate Jf$_ The method of claim 1 wherein the encoding step for 

control process illustrated in FIG. 5 also provides the 25 % e sequence at the first resolution includes the step of 

advantage of allowing target bitrates to be set individually determining an image-wide quantization parameter for a 

for both the CIF and the QCIF frame sequences, rather than g i ven i mage at tne ^ reso lution that will approximately 

requiring them to have a fixed ratio. match a target bitrale for the given image when mat image 

It should be noted that the elements of the system 40 may fa encoded ^ lhe quantization parameter . 

be implemented using a central processing unit, 3Q 6 ^ method of daim x whercin ^ encodi 

microprocessor, application-specific integrated circuit or ^ of detcrmini , t bitrales for ^rcnl 

other data processing device in a computer, video * eacfa * *> resolutions, 

transmitter, cable system headend, television set-top box or Jt i „_ f. , c . . - . , 

, a r • , -\ • , Tt.* , . 7. Hie method of claim 6 wherein the target bit rates are 

other type of video signal processor. The invention may be . . , 

utilized in conjunction with numerous types of video pro- sel independently for each of the first and second resolu- 

cessing or transmission systems, including global computer 35 Uons - 

networks such as the Internet, wide area networks, local area S - ^ method of claim 6 wherein the target bit rates of the 

networks, cable systems, satellite systems and standard first and second resolutions are maintained in a fixed ratio, 

wired telephone networks. For example, the invention is M$ ^ ne metn °d of claim 1 wherein the encoding step 

suitable for use in systems such as switched digital video ^further includes utilizing a rate-quantization model to select 

(SDV), hybrid fiber/coax (HFC), direct broadcast satellite 40 a quantization parameter for use with a given one of the 

(DBS), multichannel multipoint distribution service images of the sequence at the first resolution. 

(MMDS) and digital subscriber loop (DSL). S^- ^ De method of claim 9 wherein the selected quanti- 

The above-described embodiments of the invention are zatSon parameter is the quantization parameter which best 

intended to be illustrative only. For example, a possible matches a target bitrate for the first resolution, 

alternative embodiment of the FIG. 5 rate control process 45 The method of claim 9 wherein an estimated bitrate is 

could utilize a fixed ratio between target bitrates for the dft|fmined for the image at the first resolution to be encoded 

different resolution sequences. In such an embodiment, using the selected quantization parameter, by dividing a 

another technique, such as that described in the above-cited target bit rate for an image at the second resolution by a 

Puri and Aravind reference, may be used in place of a factor 

rate-quantization model to determine the quantization 50 /^jtgvThe method of claim 9 wherein the rate -quantization 
parameter for a lower resolution frame sequence. Other moSel is used to determine a quantization parameter for an 
possible alternative embodiments could utilize different image at the second resolution, by finding the best quanti- 
ties of information from an encoding at a first resolution, zation parameter for encoding the image at the first resolu- 
to provide rate control at a second resolution. The informa- tion>to achieve an estimated number of bits for the image, 
tion may be obtained when encoding of a designated portion 55 J$3';)The method of claim 11 further including the step of 
of a sequence at the first resolution is complete, or while the updating the factor by recomputing it as a moving average 
encoding of the designated portion of the sequence is still in of the ratio between (1) an actual number of bits used when 
progress. These and numerous other alternative embodi- encoding the image at the second resolution using the 
ments within the scope of the following claims will be quantization parameter for the image at the second 
apparent to those skilled in the art. 60 resolution, and (2) the number of bits which a rate- 
>$yhat is claimed is: quantization model estimates will be required for encoding 
Ax^A method of encoding a video sequence including a the image at the second resolution using the same quanti- 
sequence of images, the method comprising the steps of: zatroli parameter. 

encoding the video sequence at a first resolution; and An apparatus for encoding a video sequence including 

utilizing information from the encoding at the first reso- 65 a sequence of images, the apparatus comprising: 

lution to provide rate control for the sequence at a a first encoder for encoding the video sequence at a first 

second resolution higher than the first resolution; resolution; and 
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a second encoder for encoding the video sequence at a 
second resolution higher than the first resolution, the 
second encoder having an input coupled to an output of 
the first encoder, such that information generated while 
encoding the video sequence at the first resolution is 
used to provide rate control for the sequence at the 
second resolutions; 

wherein target bit rates are determined for each of the first 
and second resolutions, a first quantization parameter is 
selected for encoding at the first resolution based on the 
target bit rate for the first resolution, an estimated bit 
rate is determined for encoding at the first resolution 
using the first quantization parameter based on the 
target bit rate for the second resolution, and a second 
quantization parameter is selected for encoding at the 
second resolution based on the estimated bit rate for 
encoding at the first resolution. 

15. The apparatus of claim 14 wherein the first resolution 
is a QCIF resolution and the second resolution is a CIF 
resolution. 

16. The apparatus of claim 14 further including at least 
one additional encoder for encoding the sequence at one or 
more other resolutions, wherein the information from the 
encoding at the first resolution is utilized to provide rate 
control for the sequence at the other resolutions. 

17. The apparatus of claim 14 wherein the information 
from the encoding at the first resolution that is utilized to 
provide rate control for the sequence at a second resolution 
includes a relationship between a quantization parameter 
selected for an image at the first resolution and a resultant 
output bitrate generated by encoding the image using the 
selected quantization parameter. 

18. The apparatus of claim 14 further including a rate 
control processor associated with at least one of the first and 
second encoders, wherein the processor is operative to 
determine an image-wide quantization parameter for a given 
image at the first resolution that will approximately match a 
target bitrate for the given image when that image is encoded 
using the quantization parameter. 

19. The apparatus of claim 18 wherein the processor is 
operative to determine target bitrates for different types of 
images at each of the first and second resolutions. 

20. The apparatus of claim 19 wherein the target bit rates 
are set independently for each of the first and second 
resolutions. 

21. The apparatus of claim 19 wherein the target bit rates 
of the first and second resolutions are maintained in a fixed 
ratio. 

22. The apparatus of claim 18 wherein the processor 
utilizes a rate-quantization model to select a quantization 
parameter for use with a given one of the images of the 
sequence at the first resolution. 

23. The apparatus of claim 22 wherein the selected 
quantization parameter is the quantization parameter which 
best matches a target bitrate for the first resolution. 

24. The apparatus of claim 18 wherein the processor is 
operative to determine an estimated bitrate for the image at 
the first resolution to be encoded using the selected quanti- 
zation parameter, by dividing a target bit rate for an image 
at the second resolution by a factor. 

25. The apparatus of claim 22 wherein the processor is 
operative to utilize the rate -quantization model to determine 
a quantization parameter for an image at the second 
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resolution, by finding the best quantization parameter for 
encoding the image at the first resolution to achieve an 
estimated number of bits for the image. 
26. The apparatus of claim 24 wherein the processor is 

5 operative to update the factor by recomputing it as a moving 
average of the ratio between (1) an actual number of bits 
used when encoding the image at the second resolution 
using the quantization parameter for the image at the second 
resolution, and (2) the number of bits which a rate- 

10 quantization model estimates will be required for encoding 
the image at the second resolution using the same quanti- 
zation-parameter. 

taffij^n apparatus for encoding a video sequence including 
a sequence of images, the apparatus comprising: 

means for encoding the video sequence at a first resolu- 
tion; and 

means for providing rate control for the sequence at a 
second resolution higher than the first resolution uti- 
lizing information from the encoding at the first reso- 
lution; 

wherein target bit rates are determined for each of the first 
and second resolutions, a first quantization parameter is 
selected for encoding at the first resolution based on the 
target bit rate for the first resolution, an estimated bit 
rate is determined for encoding at the first resolution 
using the first quantization parameter based on the 
target bit rate for the second resolution, and a second 
quantization parameter is selected for encoding at the 
second resolution based on the estimated bit rate for 
encoding at the first resolution. 

28. An apparatus for encoding a video sequence including 
a sequence of images, the apparatus comprising: 

at least one encoder for encoding the video sequence at a 

first resolution; and 
a rate control processor having an input coupled to an 
output of the at least one encoder, the rate control 
processor providing rate control for the sequence at an 
additional resolution higher than the first resolution 
using information obtained by the at least one encoder 
while encoding the sequence at the first resolution; 
wherein target bit rates are determined for each of the first 
and second resolutions a first quantization parameter is 
selected for encoding at the first resolution based on the 
target bit rate for the first resolution an estimated bit 
rate is determined for encoding at the first resolution 
using the first quantization parameter based on the 
target bit rate for the second resolution, and a second 
quantization parameter is selected for encoding at the 
second resolution based on the estimated bit rate for 
encoding at the first resolution. 

29. The apparatus of claim 28 wherein the processor is 
operative to provide the rate control for the sequence at the 
additional resolution using information obtained when 

55 encoding of a portion of the sequence at the first resolution 
is complete. 

30. The apparatus of claim 28 wherein the processor is 
operative to provide the rate control for the sequence at the 
additional resolution using information obtained when 

60 encoding of a portion of the sequence at the first resolution 
is still in progress. 
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